IMAGE PROCESSING APPARATUS 

BACKGROUND OF THE INVENTION 
1. Field of the Invention 

This invention relates to image processing, particularly 
to an image processing apparatus which can be used as an 
"electronic makeup" apparatus providing high quality and 
natural looking images in a field where sophisticated works 
are required in both the contents and representation, such as 

P 

*S television dramas and movies. 

!^ 2. Description of the Related Art 

iU 

O 



It is known that by applying a two-dimensional s-filter 
(for example, refer to Harajima and others '^-Separating 
Nonlinear Digital Filter and Its Applications" IEICE (The 
Institute of Electronics, Information and Communication 
Engineers) 1982, 4,J65-A, No. 4, pp297-304) to an image of a 
human face, neck, hand, etc ., a "smooth skin" -image with wrinkles 
and spots removed or decreased can be obtained (refer to Arakawa 
and others "Color Face Image Processing by Vector e-Filter ~ 
Removal of Wrinkles~ ,/ March 1998, 1998 General Conference of 
IEICE D-ll-143, PP143-) . This will be hereinafter referred to 
as conversion to "smooth skin." This is based on the fact that 
small-amplitude light and dark change is smoothed by "separating 
and suppressing small-amplitude high-frequency noise 
components in an image", which is a function of the 
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two-dimensional s-f ilter . 

The s-filter was originally designed for the purpose of 
separating and removing the small-amplitude high-frequency 
noise components superimposed on a signal waveform. 

A low-pass filter (LPF) that is usually used for noise 
removal not only suppresses noise components, but also degrades 
edges of signals . Thus if it is applied to an image, the low-pass 
filter has the disadvantage of blurring the whole image. 
However, as shown in the relationship between the input and 
output signals of the s-filter in FIG. 1, the s-filter has a 
characteristic of flattening only small-amplitude level 
changes . in a signal waveform, and has a feature of scarcely 
impairing sharpness of the whole image because the edges which 
have steep level changes are preserved. 



! -f Letting an input signal sequence be x (m, n) , the output 



signal y (m, n) of the two-dimensional s-filter is represented 
by the following expression (1) : 



y(m y n) = x(m, «) - X X a u ' F ( x ( m > w ) " x ( m + + J)) < 1 ) 

* J 

W here ai.j is a weight coefficient. If the filter size is (2M+1) 
X (2N+1), it will satisfy the following expression: 
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The function F(x) represented in expression (1) is a 
nonlinear function shown in a graph of FIG. 2 and F(x)=0 when 

|X|>s 0 . 

Throughout the specification, the value of e 0 will be 
referred to as 8 value. 

FIG. 3 shows a basic configuration of the two-dimensional 

s-f ilter . 

In FIG. 3, the solid line frame denoted by numeral 1 
indicates a calculation section of a small-amplitude 
high-frequency noise component u (m, n) (the second term on 
the right side in expression (1) ) . Output from the calculation 
section is subtracted from the input signal sequence x (m, n) , 
whereby the output signal sequence y (m, n) with the 
small-amplitude noise component suppressed is provided. 

By applying s-filter to an image of a human face, the 
face image can be converted into a beautiful face having "smooth 
skin" with wrinkles and spots removed or decreased. The 
wrinkles and spots are not so-called noise, but involve 
comparatively small -amplitude light and dark changes in an image 
The wrinkles and spots can be made inconspicuous, by smoothing 
these small-amplitude light and dark changes with the 
small-amplitude level change suppressing function of the 
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e-filter. 

Here, only the small-amplitude level changes such as the 
wrinkles and spots are flattened and steep level changes such 
as boundaries of pupils, eyelids, eyebrows, etc., are kept, 
so that sharpness of the whole image is scarcely impaired and 
conversion to "smooth skin" can be accomplished. 

Conversion to "smooth skin" is intended for skin areas 
strictly. However, if the whole image is processed uniformly 
through the s filter, small-amplitude level changes of 

p 

43 peripheral images are also suppressed and as a result, delicate 

IIP 

^ light and dark patterns of hairs, clothes, backgrounds, etc., 

m 

are also flattened, resulting in an image where original details 
and texture are impaired. 

This is fatal in applications wherein high quality is 
demanded for the whole image such as television, movies, etc. 
However, the 8 filter is made to selectively act only on the 
skin color area of an image, whereby conversion to "smooth skin" 
can be accomplished without impairing any details or texture 
of peripheral images. To do this, a technigue called 
"chromakey" (technique of electronically discriminating a 
specific color area in an image from others and applying image 
processing such as filtering only to the area restrictedly ) , 
a well - used device in the television technical field, may be 
adopted . 

As described above, conversion to "smooth skin" through 
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the s filter has the potential for use as "electronic makeup", 
in television drama and movie production, etc. However, to 
make the most of the s filter in the field where there are various 
demands for image processing and requirements for high quality 
of the whole image, the following problems to be resolved exist : 
Conversion to "smooth skin" makes a skin image seem to 
be smooth, and thus also produces the "rejuvenation" effect 
as video representation. For an elderly actress to act as a 
girl such as in a drama of a biography, etc., although there 
are existing points to be improved (which will be pointed out 



!j* later) , conversion to "smooth skin" is a promising technique 

to be used as an electronic makeup technique where "rejuvenating 
skin" is obtained by performing image processing. 

As described above, conversion to "smooth skin" can be 
Q realized using the s filter. On the other hand, for playing 

□ an aged person drastically exceeding the actual age such as 

in a television drama or a movie, an electronic makeup technique 
for producing an "old" effect such as "wrinkle enhancement" 
is also demanded. However, hitherto, it has been impossible 
to realize "wrinkle enhancement" which can also be said to be 
the opposite effect to conversion to "smooth skin." 

In conversion to "smooth skin" using the e filter, the 
degree (strength) of conversion to "smooth skin" can be easily 
adjusted simply by changing one parameter (e Q in FIG. 2) in 
response to the strength of the wrinkles and spots to be hidden. 
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Although the whole skin becomes smooth as the degree of 
conversion to "smooth skin" is increased, the grain and texture 
of the skin are lost and "plastic" texture rather than "human 
skin" results, leading to an image poor in reality. To avoid 
this, if conversion to "smooth skin" is weakened, the natural 
look is recovered, but the wrinkles and spots to be hidden appear; 
this is a dilemma. 

In other words, a solution to "provide an image where 
the grain and texture of the skin are preserved while hiding 
annoying wrinkles and spots" becomes necessary. 

Further, assuming that the above-described "wrinkle 
enhancement" can be realized, it is desired to provide a 
"wrinkles enhanced" image with the grain of the skin kept in 
the original state rather than simple "wrinkle enhancement," 
needless to say. 

SUMMARY OF THE INVENTION 

It is therefore an object of the invention to realize 
"wrinkle enhancement" that was previously impossible, and to' 
provide an image processing apparatus for performing conversion 
to "smooth skin" without impairing the grain or texture of skin, 
and "wrinkle enhancement" with the grain of the skin preserved 
in its original state. 

Finally, according to the invention, an image processing 
apparatus is provided for performing conversion to "smooth skin 11 
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or "wrinkle enhancement" for an input image. This apparatus 
is characterized by input image signals which are applied to 
an input terminal of a a -filter, and an extended e -filter 
adapted to extract selectively or simultaneously, "wrinkle 
enhanced" signals obtained by adding the output signal of a 
small amplitude variation component calculation section of the 
e -filter to the input image signal, and "smooth skin" converted 
signals of the input image signals (which is the output of the 

previously mentioned £ - filter). 

According to this invention, an image processing 
apparatus is provided, which is characterized by having the 
JS ability to extract an input image, signal as a "smooth skin" 

iH 

?i converted signal while preserving the grain and texture of the 

3 = 

Q skin. This is achieved by applying an input image signal to 

iy 

0 input terminals of two s-f liters having large and small 8 values , 

P and adding the output signal of the small-amplitude variation 

component calculation section of the smaller s valued s-f ilter 
to the output signal of the e-f ilter having the larger 8 value. 

According to this invention, an image processing 
apparatus is provided, which is characterized by having the 
ability to get an image signal as a "smooth skin" converted 
signal or a "wrinkle enhanced" signal correspondingly, while 
preserving the grain and texture of the skin. This is achieved 
by applying an input image signal to the input terminal of a 
large s valued extended e-filter and the input terminal of a 
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small e valued e-filter. When the correction instruction is 
"smooth skin" conversion, a "smooth skin" converted signal 
preserving the grain and texture of the skin is obtained by 
adding the output signal of the small-amplitude variation 
component calculation section of the e-filter to the "smooth 
skin" converted output signal of the extended e-filter. 

When the correction instruction is "wrinkle enhancement" , 
a "wrinkle enhanced" signal preserving the grain and texture 
of the skin by subtracting the output signal of the 



small-amplitude variation component calculation section of the 
e-filter from the "wrinkle enhancement" output signal of the 
extended s-filter. 



According to the invention, an image processing apparatus 
is provided, which is characterized by having the ability to 



a "smooth skin" converted signal preserving the grain 
and texture of the skin, 

a "wrinkle enhanced" signal keeping the grain and 
texture of a skin in its original state. This is achieved by 
a new type digital filter (named "p-filter") which separates 
specific variation components within a specified amplitude. band 
When given any two large and small amplitude values that can 
be set arbitrarily, the p-filter selectively separates only 
the variation components which have an amplitude value between 
the two given amplitude values. 




selectively or simultaneously provide 
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BRIEF DESCRIPTION OF THE DRAWINGS 
FIG. 1 shows the characteristic of a e-filter based on 
the relationship between the input signal and the output signal . 

FIG. 2 is a graph of the nonlinear function F(X) used 

in the E-filter. 

FIG. 3 shows the basic configuration of a two-dimensional 

e-filter. 

n FIG. 4 shows a configuration example of the invented image 

SR processing apparatus executing conversion to "smooth skin" and 

h 

111 "wrinkle enhancement" in "one-output type". 

O 

45 FIG. 5 shows a configuration example of the invented image 

m 

Si processing apparatus executing conversion to "smooth skin" and 

P "wrinkle enhancement" in "continuously parallel output type". 

ITJ 

:jf FIG. 6 shows a configuration example of the invented image 

processing apparatus intended for "removing annoying wrinkles 
and spots with the grain and texture of the skin, the smaller 
variation, preserved" . 

FIG. 7 shows a configuration example of the invented image 
processing apparatus for selectively performing processing of 
"removing annoying wrinkles and spots with the grain and texture 
of the skin, the smaller variation, preserved" and "enhancing 
significant wrinkles and spots while preserving the grain and 
texture of the skin in its original state". 

FIG. 8 is a graph to show the nonlinear function cppL, 
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ph (X) whichdef ines thenewly inventeddigital filter (pfilter) . 

FIG. 9 shows that by using only one p-filter, high-quality 
conversion to "smooth skin" and "wrinkle enhancement" 
preserving the grain and texture of the original skin image 
can be achieved . 

FIG. 10 shows a configuration example of the invented 
"one-output type" p-filter, image processing apparatus, for 
executing conversion to "smooth skin" and "wrinkle enhancement" 
p preserving the grain and texture of the original skin image. 

s 

ij% FIG. 11 shows a configuration example of the invented 

!U "simultaneously output type" p-filter, image processing 

o 

*|S apparatus, for executing conversion to "smooth skin" and 

yi 

5i "wrinkle enhancement" preserving the grain and texture of the 

I-* 

original skin image. 
Q FIG. 12 shows a configuration example of an "electronic 

makeup" apparatus, which is configured by combining a p-filter 
and a color area determination circuit. 

DETAILED DESCRIPTION OF THE PRESENT INVENTION 
Referring now to the attached drawings, the preferred 
embodiments of the invention are shown. 

The invention will be discussed in the following order: 

(1) Realization of "wrinkle enhancement" 

(2) Realization of conversion to "smooth skin" and "wrinkle 
enhancement" while preserving the grain and texture of the skin 



- 10 - 



The filter according to the invention, which is capable 
of providing both functions of "smooth skin" and "wrinkle 
enhancement" conversion, will be hereinafter referred to as 

extended s-filter. 

Item (2) above is realized by the following three methods 

a to c : 

a. Two e-filters represented by expression (1) are used in 
combination to execute conversion to "smooth skin" with a natural 
look. 

b. An s-filter and an extended s-filter are used in combination 
in order to execute switch-able conversion to "smooth skin" 
and "wrinkle enhancement" with a natural look. 

c. A new digital filter provided by the invention is used to 
execute conversion to "smooth skin" and "wrinkle enhancement" 
with a natural look. 

First, realization of "wrinkle enhancement" in (1) will 
be discussed. 

It is difficult to make a new wrinkle at a point where 
no wrinkle exists. In this invention, the output of the 
small -amplitude variation component calculation section, which 
is a component of the s-filter, is used to enhance an original 
wrinkle . 

To execute conventional conversion to "smooth skin", the 
small-amplitude variation component calculation section, 
indicatedby numeral 1 in the s-filter , finds the small-amplitude 
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variation component of an input signal sequence and the component 
is subtracted from the input signal sequence (see FIG. 3) . 

Conversely, as shown in expression (3) , the 
small-amplitude variation component (second term on the right 
side of expression (3) ) is added to the input signal sequence 
(first term on the right side), whereby the small-amplitude 
variation component of a wrinkle, etc. , can be enhanced ("wrinkle 
enhancement") . However, the addition (same phase addition) 
result might exceed the stipulated level range of a digital 
image (for example, 0 to 255 in 8 bits range ) , thus clip processing 
after addition (processing of limiting the result to 0 if the 
result is .0 or less and limiting the result to 255 if the result . 
is 255 or more) is required. 

y (jn 9 n) = x(m, n) + ^ ]►] a t j • F(x(m, ri) + x(m + /, n + jj) ( 3 ) 

' j 

It is convenient and cost efficient to integrate the 
apparatus for realizing "wrinkle enhancement" with the existing 
apparatus for realizing conversion to "smooth skin", and enable 
both conversion to "smooth skin" and "wrinkle enhancement." 

As the integral circuit configuration, the following two 
configurations are possible: 

(a) Configuration wherein either "smooth skin" or "wrinkle 
enhancement" conversion signal is output (which will be 
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hereinafter referred to as "one-output type"), and the 
smail-amplitude variation components are added / 
subtracted to / from the input image in response in to an 
external conversion instruction (-"smooth skin"/ "wrinkle 
enhancement" ) and 
(b) configuration wherein the processed results of conversion 
to "smooth skin" and "wrinkle enhancement" are output 
simultaneously, which will be hereinafter referred to as 
"simultaneous output type," and either can be selected for use 
as required. 

(both configurations will be referred to as extended e-f ilters 
throughout the specification.) 

FIGS. 4 and 5 show configuration examples of the invented 
image processing apparatus for executing conversion to "smooth 



O skin" and "wrinkle enhancement" in the forms corresponding to 

G 

0 (a) and (b) above. In FIGS. 4 and 5, the portion of the solid 

line frame indicated by numeral 1 is a calculation section of 
a small-amplitude variation component U (m, n) . A conversion 
instruction section indicated by numeral 2 in FIG . 4 is a section 
for instructing the image processing apparatus to perform either 
conversion to "smooth skin" or "wrinkle enhancement." Each 
apparatus comprises a clip circuit (Clip) for suppressing the 
addition (same phase addition) result of the small-amplitude 
variation component for "wrinkle enhancement" to the stipulated 
level range of a digital image (for example, 0 to 255) . 
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Next, the method of realizing conversion to "smooth skin" 
while preserving the grain and texture of the skin by using 
twoe-filters represented by expression (1) in combination (the 
method in (2) a. described above) will be discussed. 
First, the principle will be discussed. 
A wrinkle, a spot, and grain of the skin are all 
comparatively small-amplitude level changes (amplitude 
variation) . However, if a wrinkle and a spot at an annoying 
level are compared with the grain of the skin, generally the 
amplitude variation of the grain of the skin is comparably minute . 
So-called image pickup noise is a possible variation element 
. close to the amplitude variation of the grain of the. skin, but 

IU 

' the image pickup noise may be ignored in high-quality image 

S.JL 

q pick-up conditions of television and movies. 

lU 

q In other words, there is the following relationship among 

q 

O them: 

Amplitude variation of wrinkles or spots > amplitude 
variation of grains and textures of skin >> image pickup noise 

Incidentally, if a small amplitude value sh adequate for 
removing wrinkles and spots (conversion to "smooth skin") is 
processed as the s value (see FIG. 2) through the e-filter 
represented by expression (1) , the level change concerning the 
grain of the skin will, of course, also be suppressed. 

On the other hand, according to the operation principle 
of the e-filter, the minute-amplitude variation component u 
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(m, n) , provided by setting a minute amplitude value sL (sL<eh) 
as the s value (which matches the amplitude variation for the 
grain of the skin) , and processing it through the e-f ilter, 
is a level change related to the grain and texture of the skin. 
Therefore, in the invention, it is used to revive the grain 
and texture of the skin which was lost in previous technique. 

In other words, in order to "preserve the grain of the 
skin with smaller variation width while removing annoying 
n wrinkles and spots (conversion to "smooth skin")," 

Ice? 

jjy (a) the original image is converted to "smooth skin" using a 

fy small amplitude value sh through s-filter I (here, the grain 

Q ■ 

a |3 component is also suppressed) ; 

< ; (b) the level variation component with minute amplitude (grain 

component) is separated from the original image using the minute 
amplitude value 8L through e-f ilter II; and 

(c) the level variation component with minute amplitude 
separatedin (b) is added to the processing result of the "smooth 
skin" conversion in (a) . 

FIG. 6 shows a configuration example of the invented image 
processing apparatus for performing the signal processing 
described above. 

Next, themethodin (2) b. described above will be discussed, 
namely, the method of using extended s-filter I and e-filter 
II in combination in order to realize switch-able conversion 
to "smooth skin" and "wrinkle enhancement" with a natural look. 
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Also in this method, in order to execute conversion to 
"smooth skin," the minute-amplitude variation component u (m, 
n), provided through the e-filter II, is added to output of 
the extended e-filter I as explained in the method (2) a. 
described above. Thus the grain and texture of the skin which 
had been lost in previous technique is revived 

In contrast, in order to execute "wrinkle enhancement/' 
enhancement of the grain based on the minute-amplitude variation 
component u (m, n) , which is essentially undesirable, is canceled 
for restoring the original grain level. 

l|| In other words, in order to "enhance significant wrinkles 

P 

4S and spots while preserving the grain of the skin in its original 

m 

f state," 

O (a) wrinkles of an original image are enhanced according to 

small amplitude value eh, by using extended e-filter I (here, 
the grain component is also enhanced) ; 

(b) level variation component with minute amplitude (grain 
component) is separated from the original image, using the minute 
amplitude value eL through the e-filter II; and 

(c) the level variation component with minute amplitude 
separated in (b) is subtracted from the processing result of 
"wrinkle enhancement" in (a) . 

FIG. 7 shows a configuration example of the invented image 
processing apparatus, for selectively performing processing 
between "preserving the grain of the skin, which has smaller 
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variation width, while removing annoying wrinkles and spots" 
and "enhancing significant wrinkles and spots while preserving 
the grain of the skin in its original state." 

In FIG. 7, a minute amplitude component adjustment section, 
indicated by numeral 3, is a section for performing adjustment 
processing of a minute amplitude variation component. This 
section is for executing the algorithm of the minute amplitude 
variation component u2 (m, n) , which is separated through the 
n e-filter II for output yl (m, n) of the extended e-filter I, 

fji in response to the correction instruction for conversion to 

!U "smooth skin" or "wrinkle enhancement" (addition if the 

M 

s |S instruction is conversion to "smooth, skin" or subtraction if 

jj zzs 

; ! the instruction is "wrinkle enhancement") . 



In this case, the extended s-filter I is provided for 
performing conversion to "smooth skin" or "wrinkle enhancement" 



III 

in accordance with the correction instruction; this topic was 



previously described with reference to FIG. 6. 

Next, the method in (2) c. described above, will be 
discussed. This is the method to realize conversion to "smooth 
skin" and "wrinkle enhancement" with a natural look by using 
a new digital filter provided by the invention. 

First, the method in (2) a. described above, will be 
reviewed. This is the method of using two s-filter s in combination, 
represented by expression (1) , in order to perform conversion 
to "smooth skin" with a natural look. This method is executed 
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according to the configuration previously described with 
reference to FIG. 6. 

Signal processing performed according to the 
configuration in FIG - 6 is represented by expression (4) . In 
expression (4) , the first term on the right side (enclosed in 
braces) indicates the function of the s-filter I (conversion 
to "smooth skin" based on e=eh) . The second term on the right 
side following the first term indicates the function of the 
s-filter II (separation of the variation component "related 
to the grain of the skin" of amplitude s or less) . 

y(m 9 n) = |jc(iw, ") ~ Z X a ij ' F * ( x ( m > n ^ " x ^ m + <> + »)| + S Z a u ' F * w > " x< < m + 

(4) 

Now, if expression 4 is sorted out by focusing attention on: 

' J 

the following expression (5) is obtained. 

y (m 3 n ) = x ( m ,n)-Y J Ys a u * i F * ( x ( m > w ) ~ xi < m + n + ^ ~ F ** w) ~ x(m + n + 7 ^ 
' J 

(5) 

The Fe (X) (see FIG. 2) returns the same value for x with 



|X|<e, otherwise it returns 0. Thus, Feh (Ax) andFeL (Ax) becomes 
the following: 

When |Ax|<eL, Feh (Ax) = Ax, FeL (Ax) = Ax 
when eL<:|Ax|<eh, Feh (Ax) = Ax, FeL (Ax) = 0 
when eL<|Ax|, Feh (Ax) = 0, FeL (Ax) = 0 

Therefore, the whole portion represented by {Feh (Ax) - FeL 
(Ax) } in expression 5 has a characteristic of outputting the 
same value only for the variation component Ax contained in 
P the amplitude band with eL<|Ax|<eh, and otherwise outputting 

This characteristic indicates a new nonlinear function 

b 

defined by two parameters PL and ph as shown in FIG. 8 (cppL, 

: j ph (x) ) . 

;3 Using the new nonlinear function (ppL, ph (X) , expression 

iu 

S (5) can be rewritten as the following expression (6) : 

Q 

O 



y(m y n) = x(m, w)-^ a i } • ^ fiM (x(m, n) - x(m + /,« + _/)) ( 6 ) 



In other words, expression (6) indicates the 
characteristic of a new nonlinear digital filter, which uses 
a new nonlinear function <pPL, ph (X) to separate and suppress 
only the variation component of a specific amplitude band. 
This will be hereinafter referred to as "specific amplitude 
band variation component separation type digital filter 7 ' (or 
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p-filter) . As seen from the fact that expression (6) is derived 

from expression (4), the function is the same as the function 

provided by using two s-filters in combination shown in FIG. 

6 . Therefore, one p-filter can accomplish conversion to "smooth 

skin" while preserving the texture of the skin in one process. 

The p-filter can provide not only the suppression function 

of the separated specific amplitude band variation component 

(conversion to "smooth skin") , but also the enhancement function 

of the variation component ("wrinkle enhancement") . This is 

S similar to how the expanded e-f ilter is provided, by attaching 

y = 

jfi the e-f ilter output with the configuration of adding the small 

]jE amplitude variation component separated through the s-filter 

IH 

s; to an input image signal . Thus, as shown in FIG. 9, it is possible 
]»& 

□ for one p-filter to cover high-quality conversion to "smooth 

P skin" and "wrinkle enhancement", while considering the gram 

P 

O of the skin (in the previously described configuration FIG. 

7, twofiltersof extended e-f ilter I ands-f ilter II are required) . 
Therefore, an "electronic makeup apparatus" for producing 
natural processing results in a simple configuration can be 
provided . 

In the basic configuration of the invented image 
processing apparatus using the specific amplitude band 
variation component separation type digital filter (or 
P-filter) , the following two configurations are also possible: 
(a) "One-output type," configuration wherein one correction 
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output of conversion to "smooth skin," etc., is adopted. The 
algorithm of a specific amplitude band variation component for 
an input signal ( subtraction or addition) is changed in response 
to an external correction instruction (instruction for 
performing "smooth skin" or "wrinkle enhancement"); and 
(b) "Continuously parallel output type, " configuration wherein 
the processing results of conversion to "smooth skin" and 
"wrinkle enhancement" are output continuously, and either can 
be selected for use as required. 

This is similar to the configuration example of the extended 
s-filter, provided by adding the function of enhancing a 
small-amplitude variation component to the configuration of 

the conventional 8-filter. 

FIGS . 10 and 11 show configuration examples of the invented 
image processing apparatus for executing conversion to "smooth 
skin" and "wrinkle enhancement" through the p-filter in the 
forms corresponding to (a) and (b) above. In FIGS. 10 and 11, 
the portion of the solid line frame indicated by numeral 4 is 
a specific amplitude band variation component calculation 
section. Each apparatus (FIG. 10, 11) also comprises a clip 
circuit (Clip) for suppressing the addition (common-mode 
addition) result of the specific amplitude band variation 
component for "wrinkle enhancement" to the stipulated level 
range of a digital image (for example, 0 to 255) . 

The P-filter provided by the invention will be further 
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discussed. 

The function 9pL, ph (X) , which is the fundamental part 
of the p-filter, is characterized by the fact that it is a 
nonlinear function acting only on level variations having an 
amplitude value between the two amplitude values (ppL and ph 
(X) (cppL < |X | < ph) , and does not involve minute variation 
amplitude in the proximity of 0. Both functions of the 
conventional e-filter, function cppL, ph (X) and nonlinear 
function F (X) shown in FIG. 2, define the filter requirement 
in the amplitude area of level variation; the essential 
functional difference between both functions 9pL, ph (X) and 
F (X) can be. compared to the difference between a band-pass 
filter and a low-pass filter in frequency area. 
□ In other words, the nonlinear function (ppL, ph (X) is 

Q introduced, whereby producing digital filter capable of 

O 

p selectively separating and suppressing or enhancing only level 

variations contained in a specific amplitude band of an input 
signal sequence consisting of level variations of various 
amplitudes . 

As previously described with reference to related 
previous documents, the s-f ilter is a filter originally designed 
for the purpose of removing small-amplitude noise. For the 
purpose of removing noise, the function with the form as shown 
in FIG. 8 is not considered as the nonlinear function to be 
used. This is because in noise removal, it is not possible 
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to remove noise in one amplitude band while saving minute 
amplitude changes. 

Therefore, the digital filter, which is defined by these 
nonlinear and linear functions and provided by this invention, 
was produced from the purpose and idea entirely different from 
those of previous technique. This enables new applications 
in each field. 

Finally, by combining the use of the P filter and a color 
area determination circuit, image processing for executing 
higher-quality conversion to "smooth skin" or "wrinkle 
enhancement" while considering the grain of the skin and 
preserving peripheral details and texture is made possible. 



I'm 

' Jl The configuration demonstrates further effectiveness as an 



"electronic makeup" apparatus in fields of television and movies, 
etc . 

FIG. 12 shows a configuration example of the "electronic 
makeup" apparatus having such a configuration. 

In FIG. 12, a color area determination circuit 5 determines 
a specific color area specified in parameters in an input image 
signal. A changeover switch 6 is controlled, based on the 
output of the color area determination circuit 5 , so as to extract 
the output y (m, n) of the p filter as the output signal only 
in the determined color area, and output the original image 
signal for other areas. 

As described above, the invented image processing 
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apparatus . uses the small amplitude variation component 
separation function of the e-f ilter and the specific amplitude 
band variation component separation function of the (Je-filter 
provided by the invention to correct the input image signal 
sequence as a two-dimensional image. Thereby executing 
"wrinkle enhancement" and conversion to. "smooth skin" and 
"wrinkle enhancement" with a more natural look. The concept 
of separating and weakening or enhancing the small amplitude 
variation component and the specific amplitude band variation 

O 

*0 component, which is the basic principle of the invention, can 

IP 

be applied to the processing of one-dimensional signals as 
so-called time-series signals, needless to say. 

fifes 
S P 

Accordinq to this invention, the effects of 

i\ 

M 3 

"rejuvenation" and "old age" with a natural look for video 

iv 

p representation in television and movies, can be produced in 



a more natural form by image processing. 
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